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'lTie words on this list arc used in this booklet. Please review the terms and learn the definitions. Tl 
words as used in the text may not be the form of the word with which you are familiar. 

Words/Terms 

1. Anecdotal In the form of a short narrative statement about tin incident or behavior usual 

observer 

2. Application A use to which something is put 

3. Appwpriate Fitting or especially suitable 

4. Assess To determine the importance, size or value of something 

5. Attitude A feeling, emotion, posture and subsequent behavior toward a fact, state or situntio 

6. Certify To confirm or inform with certainty in a formal way to someone else; some set of fa 

7. Confirmation The support of tin idea or conclusion through evidence 

8. Conjunction The state of being joined together 

9. Consensus A judgement arrived at or agreed to by a group 

10. Continually Occurring indefinitely 

11. Evaluation The process of determining the value of an object, program, or effort 

12. Explicit Clear and publicly stated 
13- Invaluable of great worth 

14. Interaction Mutual Influence or discussion 

15. Legitimacy Acceptability within general rules and standards 

1 6. Limitation A restriction or boundary 

17. Negative construction Using the words Not or Never in sentences 

18. Norms Hxpected, average behavior 

39. Performance The execution of action or activity in accord with fulfilling some expected re< 

20. Periodically Occurring over time at expected intervals 

21. Performance Achievement Testing The type of assessment that focuses on what a learneractu 

do as well as how well he/she can do it. 

22. Plausible Appearing worthy of belief 
23- Prescribe To lay down a rule 

24. Prespecified laid out or indicated in detail or explicitly as a rule before an activity occurs 

25. Orientation The usual general or lasting direction of thought or position 

26. Representative Serving as typical example 

27. Scenario An outline or account of a proposed course of action or events 

28. Self-Reporting Answering for one's self 

29. Specification A detailed or explicitly stated expectation 

.0. Testfne The nrocess c llee nttdaa rn r ain nasa n beha lor or n r ar 


What Is The Series About? 

elated subjects instruction is an essential part of every 
irenticeship program. It is the program component 
nigh which apprentices are taught the background 
ory and range of application of associated technical 
jects such as mathematics, science and safety. Related 
ruction usually takes place in a classroom, after the 
ular work is over. Most frequently, related instruction is 
7ht by a skilled tradesperson or cmftworker. For the 
lesperson or craftworker to be an effective trainer, he or 
must not only know their trade skills, but also they 
t use teaching skills appropriate for conveying that 
irmation to apprentices, 'ibis series of materials is written 
rain related subjects instructors in the critical leaching 
Is necessary to perform their jobs effectively. The titles 
e booklets in tire series arc: 

1. Introduction to Related Subjects Instruction and In- 
Seivice Training Materials 

2. Planning (be Apprenticeship Program 

3. Planning Related Subjects instruction 

4. Developing Instructional Materials for Apprentices 

5. Presenting Information to Apprentices 

6. Directing Learning Activities for Instruction 
. Providing for Individual Learner Needs 

. Controlling Instructional Settings 
9. Evaluating Apprentice Performance 
). Communicating with Apprentices 

Ire first booklet introduces tire series, describes the con- 
t of each booklet, and provides an overview of appren- 
ship and of adult learners. Tire second booklet describes 
v to plan an apprenticeship program and may be used 
elated instructors, sponsors or service agencies. Haeh of 
other eight booklets deals with a set of training skills 

jpf h n mne nfpvnprtsnn 'itinrenriredilti t herririri 


judgment—or evaluation—we make decisions and 
action. 

Asa related instructor, you must evaluate apprentice 
fornrance. You must determine if apprentices are lest 
the necessary skills, attitudes and knowledges to wo 
competent journeyworkers. Further, you must report t< 
program sponsor apprentice progress in mastering 
content. To perform effectively in these tasks, you mus 
a variety of skills associated witlr developing and using 
and test results. This booklet provides instruction in fo 
the most important skills involved with evaluating apj 
lice performance: 

1. Assess Apprentice Knowledge and Skills 

2. Devise/Use Instruments to Assess Work Attitude:: 
Traits 

3. Discuss Individual Evaluation Results with Appren 

4. Develop Instrumentation to Certify Skills I )pon C 
pletion of Course 

What Must I Do To Complete 
My Work In This Booklet? 

Working your way through this booklet will require 
to read the text, to answer tire questions, to perform 
exercises, and to complete the pre- and post-assessr 
Instruments. Expect to spend about five hours wor 
through tire materials. Tire only resources you nee 
complete your work in tills booklet are: (Da copy o 
booklet; (2) a pencil or pen; (3) about two hours of t 
and (4) recollection of past related instruction experiet 

Tire materials are written in a self-instructional, prog 
med format. You may work through tire text, examples 
questions at your own pace and leisure; you need 
complete your work in the booklet at one sluing. 



Your activities in working through this booklet will in- 
hide, in order, the following things: 

• Complete the self-assessment; 

• Read and consider in detail the introduction and 
objectives for each skill; 

• Read and study the text, examples and illustrations 
provided for each skill; 

• Complete the self-test exercise for chapter and com¬ 
pare your answers with those provided in the appen¬ 
dix; 

• If you complete the exercise as directed continue 
your work in the booklet; if you fail to answer the 
questions correctly, repeat your work in the chapter 
under consideration; and 

• At the conclusion of the booklet, complete the post¬ 
test for the unit. Check your answers against those 
provided. If you exceed the criteria, continue your 
work in the nest booklet. If you fail to demonstrate 
mastery, repeat portions of this booklet as needed. 


manee. Read each competency statement listed in Fi 
and assess your level of knowledge about and your 1 
skill in performing that task. Knowledge means wf 
know about the subject while skill means your expe 
in successfully performing the task. Circle the numb 
best describes your level of knowledge and skill. C 
tendes where your ratings arc poor or fair arc tho 
you should concentrate on. Pay particular attention 
diapters which deal with those competencies. 


in Book 


Competencies 


Poor Hair Good 


2. Skill: Assess 
apprentice 
knowledge and 
skill 


1. Distinguish between different types of Knowledge 1 2 3 

tests (knowledge stimulation, and Skill i 2 3 

sample) based on setting and purpose 

2. Construct tests of the work sample, Knowledge I 2 3 

knowledge and simulation types Skill 1 2 3 

3. Construct multiple choice test items Knowledge i 2 3 

Skill 1 2 3 

4. Construct short answer test items Knowledge 1 2 3 

Skill 1 2 3 


5. Critique and correct test items Knowledge 1 2 3 

_Skill_ 1 2 3 

6. Construct checklists Knowledge 1 2 3 

Skill 1 2 3 


3. Skill: Devise and 
use instruments 
to assess work 
attitudes 
and values 


7. Identify important work-related 
attitudes 

8. Construct and use rating scales 


9. Construct and use anecdotal records 


4. Skill: Discuss 
individual 
evaluation results 
with apprentices 


10. Identify functions of discussing test 
results 

11. Explain and use procedures for 
discussing individual evaluation results 


5. Skill: Develop 
instrumentation 
to certify and 
report skills 
upon 

completion of 


12. Develop individual performance 
records 

13 Develop group or long term 
performance record 

3 4. Develop individual time records 


Knowledge I 

Skill 3 

Knowledge 3 

Skill _1_ 

Knowledge 3 

Skill 3 

Knowledge 3 

Skill _[ 

Knowledge 1 

Skill 1 

Knowledge 1 

Skill _1 

Knowledge I 

Skill I 

Knowledge 3 


2 

2 

2 

1 

2 
2 

2 

2 
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3 

3 

3 

3 

3 

3 

3 

2 

3 
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3 

3 
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Introduction And Objectives 

•valuating apprentice skills and knowledges is an csscn 
and inescapable duty of all related subjects instructors. 

fortunately, few teachers of adults, including many related 

dies instructors, have had formal training in tasks assoc! • 
d with testing. Instead, evaluation skills have been learned 
ougli trial-anderror. As a result, testing too often emphn- 
■js less important information or generates information 
t may be of little use to you as an instructor, 
rhe purpose of these materials is to ensure that you are 
: entrapped by these short comings. Working through 
sc materials will sharpen your evaluation skills and 
wledges so that you and the apprentices you train bene 
from the time and effort you jointly invest in assessing 
rning and performance during related instruction. When 
j have completed your work in this unit of materials you 
I demonstrate your competence in evaluating trainee 
awledge and skills by being able to: 

I. Distinguish between types of tests useful for assessing 
knowledge and skills; 
l Critique sample test items; and 
y State the rules for constructing various types of test 
items. 


Why, What And When To 'lest 

Hie type of testing with which you must be concerned is 
ried “Performance Achievement Testing" or "PAT" in 
> set of materials. It is well-suited to related subjects 
iruetlon because it is action-oriented and uses observable 
lavior to assess learning. 

rhere are three major types of performance achievement 


Work Sample 

The work sample test is the type of performance aeh 
ment test with the highest degree of realism. Use 
measure direct application of knowledge and skills 01 
job. Usually a work sample test the sample test rec] 
apprentices to demonstrate learning outcomes on th< 
by evaluating work procedures and products on a sai 
set of tasks. The sampled tasks must include the most 
cal elements of the skills and knowledges that have I 
taught. Also they must be representative of the total r 
of possible performance outcomes. To insure that you 
selected the most critical learning outcomes to test, us 
you and the journeyman supervisor should analyze tlr 
and reach consensus about the importance of required t 
skills and knowledges. To Insure that the apprentice t 
tested understands the expectations of the perform 
situation, you should write out the test directions. Inc 
information about the sequence of work activities ant 
test directions such as howto record answers, how sex 
will be accomplished, the value of different answers 
time limits for certain questions and tasks. 

Frequently a work sample test will involve several ’ 
stations and many apprentices. In such instances, 
apprentice works alone at a single work station, perfori 
required tasks while other apprentices work indlvkiua 
other work stations. Time limits are placed on aetiv 
each work station. When time expires, the apprentices i 
on to another station. Learning outcomes for each ap| 
tice are tested at each work station. The activity' at 
work station should be independent of work tit any < 
workstation. Usually, because of the number of apprer 
and work stations, assessment will include use of died 
rating scales and written learner answer sheets. A cliff 
test answer sheet is usually necessary for each work str 


rk sample, the apprentice merely applies the skills or 
iwledgcs to a described situation. The situation can be 
sented ns a role play, as practice or as written description. 
?ach instance, you as an instructor present the apprentice 
h a life-like situation(s) in which he or she must manipu- 

> job related skills and knowledges to solve a work 
ibletn or perform a work task. 

•xamples of simulation rype tests include written tests 
t require the apprentice to imagine himself/herself as a 
rncyman in a work setting and to respond appropriately 
a series of situations. For example, a petro chemical 
intenance apprentice could be presented with a scenario 
which an electronic recording or regulating instrument 
s. The apprentice could be asked to describe, one step at 
me and in order, how lie or she would diagnose the 
ilpment problem. In addition, once the problem was 
nosed, the apprentice could be asked how to correct 
difficulty. The apprentice could be required to describe 
evidence that he or she would accept as confirmation of 
tain difficulties causing the problems and the evidence 
t he or she would require to believe that the problem 

> corrected. 

Knowledge 

lie knowledge type of performance achievement test 
two forms: identification and recall. The identification 
5 of test involves providing the apprentice with back- 
und information either as a question or in a situation 
I requires the apprentice to identify the procedure or 
I necessary to deal with the situation. Ifthe test requires 
ntiflcation of tools or tool parts, you should require also 
[ the specific function of the tool or part be noted, 
lie traditional tests given in most educational settings 
the recall type test. These paper and pencil tests require 
'tiers to recognize, recall and distinguish between the 
iwledge learned in a unit of instruction in order to 

.. „.. —^ , l,„t __* 


why he or she chose each device in each situation. 

Testing must take place at appropriate intervals thre 
out the related subjects instructional process. To be 
useful, it .should be a standard activity that occurs 
completing a unit of instruction. At a minimum, you 
assess acquired knowledge and skills in time for the 
odic review of each apprentice by the program sponsi 

The decisions you must take in order to eva 
acquired knowledge and skills include (a) determ 
what kind of test to give, (work sample, simulntk 
knowledge); (b) the type of test you want to use 
(c) the content of the specific test item. For purpos 
related subjects instruction, three types of test item 
recommended: (1) multiple choice, (2) short answc 
(3) checklists. The usefulness of the times for the clifi 
types of tests varies. Multiple choice and short answer 
are useful on both types of simulation and knowledge 
Checklists may he used only witli simulation-work si 
and knowledge-identification types of tests. Checklist; 
not be used with knowledge recall or simulatlotvsitu 
type tests. 

How To Construct And Use A Test 
To Assess Apprentice Knowledge 
And Skill 

Given tlie necessity of evaluating apprentice Icat 
spend your assessment time as productively as pos 
Use the following suggested steps to insure a good r 
on your time investment. 

Step /.- Select Test Type and Timing 

Review your Plan for Instruction noting the perforn 
objectives for the unit of materials and tlie suggested 
for testing. Decide when in the instructional cycle you 
to test trainees. As you review the performance obje 




Avoid using ambiguous statements in any of Che test 
material; 

. Avoid using vocabulary that is difficult or unrelated to 
the desired learning outcome, 

. Avoid using unclear directions, 

. Avoid using complicated syntax or sentences; and 
. Avoid providing unintended clues to the correct or 
best answer. 

tiplechoice items 

lultiple choice items offer great flexibility for assessing 
ypes of performance outcomes because you as instructor 
rol the background information, the alternative answers, 
the level of performance the apprentice must demon¬ 
te to answer the question correctly, 
multiple-choice item is made up of two parts. The first 
is called the stem. The stem is written as a question or 
sentation. It provides the background information for 
test item as well as the specification of the type of 
ration the apprentice must use to answer the item 
ectly. The second part of the item is the set of alter 
ve answers, one of which Is either the correct answer or 
best answer for the problem presented. The other 
rnative answers are called distractors. In the following 
npie, the stem and the alternatives are identified. 

n. Which of the following types of non-verbal com 
munication usually conveys the most information? 

motives: 
voice tone 
eye contact 
, hand gestures 
. posture 

lie major advantages of multiple choice items are fiexl- 
ry and scoring ease. The major disadvantages are the 
)unt of time it takes to write good questions and the fact 


stem snouia ne unuersioou wunoui locking ■ 
alternatives. 

Example: 

Poor stem. While everyone processes inforn 
mentally at a different rate, what is the av 
number of words per minute most peopl 
process? 

Belter stem. About how many words per tv 
can the average person's mind process? 

3. Construct four (4) or five (5) alternative answ< 
each stem. Be sure that only one alternative is c 
or represents the best possible answer. 

4. When possible avoid negatively stated items, < 
in stems or alternatives. If negative construct 
used, emphasize the negative construction by 1 
lining or capitalization. 

ibcamplc: 

Poor construction: Which of the followin 
haviors is not a bad listening habit? 

Better construction- Which of the follow! r 
haviors is not -a had listening habit? 

5. Write each alternative so that it is grammai 
consistent with the item’s stem. Also, tty to 
each alternative approximately the same length 
other alternatives. 

Example: 

Poor construction When offering feedbac 
speaker after receiving a communication 
should: 

a. describe what you saw and think you 
so you deal with the facts 

b. focus on behavior and individual perse 

c. focus on judgement and evaluation 


otiier items or so that nil items that depend upon the 
same background information are identified clearly 
in the directions. 

8. Unless important, avoid using choices of "all of the 
above" and "one of the above" since both contribute 
to guessing or can be used as clues. 

9. Make all alternative answers plausible and avoid clues 
that may permit elimination of incorrect answers or 
guessing of the correct answer. Kxercise care so that 
you avoid (a) using key words in the stem and alter 
natives; (1>) stating the best or correct answer in 
formal or textbooklike language; (c) stating the best 
or correct answer in greater detail; and (d) using 
two responses with the same meaning. 

10. Improve alternatives by (a) stating each in the lan¬ 
guage of the learner; (b) using common misconcep¬ 
tions or errors; and (c) making each alternative simi¬ 
lar In wording, length, emphasis and kind. 

You may use multiple-choice items for both simulation 
nd knowledge type tests. They can be written to assess 
loth knowledge of subjects and application of information 
o realistic situations. Kach of the examples displayed In 
r igure 2 demonstrates use of a multiple-choice question to 
ssess a skill or knowledge on a different type of related 
ubjects instruction test. Note that some Items are simply 
:nowledge-recall while other Items require the learner to 
pply information to answer the question correctly. 

hort answer items 

Short-answer items can be used for the same purposes as 
niltlple-choice Items. They are somewhat easier to con 
iruct, but more difficult to score because of partially correct 
nswers, penmanship and obtuse responses. However, they 
re as useful as multiple-choice items. Tests frequently will 
iclude Items of each type. 

'TM_!._! ~ ... I 
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.1 


Knowledge - Recall 


1. A fulcrum is a(n) 


a. lifting machine 

b. pivot point on a 
e. unit ofnccclcrat 
d. inclined plane 

Knowledge-Identification 2. The tool illustratec 

a. hacksaw 

b. compass saw 

c. bandsaw 

d. ripsaw 

Simulation-Situation * Using the followin 

drawing solve eael 
problem below. Si 
all work cm back c 
sheet. 



3. The total surface a 
above ground of tl 
figure in square fe 
approximately: 

a. 692 square feet 

b. 642 square feet 


4. Relate questions clearly to prescribed learning out¬ 
comes. 

5. Prescribe the length of time that is available for con¬ 
structing the answer and do not permit a choice of 
questions. 

Scoring short-answer tests is both more time consuming 
d more difficult than scoring multiple-choice questions. 
> simplify this task, construct a model answer to use as a 
iide before giving the test. Be sure to consider how you 
I! grade answers that are "dose” or partially correct. 

/Vs you grade the papers, mark the same answer on each 
prentice’s paper rather than marking all answers on any 
ie paper at one time. This will insure more consistency in 
tding each question for all apprentices. The techniques 
;o will help you to keep grading time to a minumum and 
insure that you treat all apprentices equally. 

wcklists 

Checklists are useful for evaluating work setting-simula- 
insane! work samples. Focused specifically on procedures 
her than products, checklists direct an observer's auen- 
m to critical aspects of performance such as necessary 
lls and knowledges. They offer the observer a yes/no 
ernative for deciding whether the specified aspect of 
rformance in question was displayed. The observer notes 
? occurrence of the desired performance at the appropri- 
: spot on the checklist as the apprentice works. You score 
heeklist by summing the number of checks and compar- 
j the sum, as well as the specific items checked, against 
? performance criteria. 

The limitations of the checklist include: (1) it fails to 
licate how well or thoroughly the aspect of performance 
s enacted; (2) it is subject to the individual judgement of 
oh observer; and (3) it is limited to skills and knowledges 
tt have observable characteristics. 


UJJ UK oil uuv.mmiwn ... 

on that same page. Also provide a specific and standnre 
to respond as well as a place for test answers. 

e Write comprehensive test directions that explair 
test purpose, the time allowed to complete the test, 
how to record the answers. 

f Reproduce the test and use with the ;tpprentic< 
your charge. 

Lxample 

A W. Belfour, a related subjects instructor for plum 
apprentices, was responsible for the first year of re 
instruction in a four-year program. Apprentices in the 
gram were reviewed every six months so his testing h; 
provide results to the sponsor at least that often. A 
reviewed his plan for instruction, including perform 
objectives and proposed course content, he decided 
the best testing schedule would place a test at the ei 
each content unit. This meant about one test ever 
weeks. The content units were topics such as cutting . c 
turn! openings, characteristics of different types of matt 
and so forth. Using the steps suggested in tills ehapte 
decided to use simulation-situation type tests where 
sible. Also, he decided to use a series of short-answei 
multiple-choice type test items. As lie sun-eyed the matt 
on measuring, cutting and assc*tubling pipe, he develi 
test items like those displayed in Figure 3- Note tin 
followed tiie steps listed in the unit as well as the rule 
writing multiple-choice and short-answer items. Be 
reported the results to the sponsor at the eonclusic 
each unit of material. He was confident that he had asst 
both knowledge and application. 


hooks. 


use of cast iron pipe: 

a. Steam fittings 

b. high pressure fittings 

c. soil pipes and fittings 
cl. gas cook bodies 

*5. The local community college is repluinbing one of the 
diLMnistry labs. While most of the lab is a general purpose 
area, two desks and supply tables -are used for experi¬ 
ments that require distilled water from a supply source. 
What kinds of piping would be suitable for plumbing this 
area given what you know about the characteristics of dif¬ 
ferent types of pipe? 

Answer _ 


R. L libel. Essentials of Educational Measut 
Edition, Englewood Cliffs, NJ. Prentice Hall 
N. !• Gronland. Constructing Achievement Test 
Cliffs, NJ: Prentice-Hall, Inc., 1968 
W. J. Popham (Kd.) Criterion Referenced A 
Englewood Cliffs, NJ: Educational Techno 
tions, 1971. 


6. Given two 90° ells, how long must you cut a piece of 1" 
pipe to give you a c.c. measurement of 22 inches with 
both ells attached? 

Answer:_ 


Answers: 

4. b 

5. glass, tin 

6. Cut the pipe 20" long, thread and screen on both 

ells. A c.c. will be 22 inches. 


:mploycd in each situation. 

•V A related subjects instructor in glazing decided to assess apprentice understanding of types of sealants. He 
described ten different situations in which a sealant was to be used and asked each apprentice to identify the most 
appropriate sealant, given the circumstances. This was an example of a what type oi'test? 

Answer: _____„__ 

3. Each machinist apprentice was required to answer correctly 8096 of twenty equations that required solving for an 
unknown. This was an example of what type of test? Answer:--- 

A meat cutting apprentice was required to identify by name six major cuts of beef from a forequarter. Tills was an 
example of what type of test? 

Answer: ----- 

tend each of the following two test items and note the problems with the item in the blanks provided after each item. 
V In our course on printing composition processes, four types of indentation were taught. They were: straight 
matter, poetry,_and__ 

Problems Noted: 


3. Which of the following items is not a safety rule for using a hammer properly: 

1. Don’t strike wood or plastic handled chisels. 

2. Don’t pound with cheek of hammer. 

3. Don’t pound sharp objects witli mallets. 

•i. Always tap object lightly before hard strike to set eye on target. 

Problems Noted: 



Attitudes And Values 


Introduction And Objectives 

lave you ever known a worker who got fired because 
or her behavior—not his or her craft skills—did not 
ch the behavior expected by the foreman, supervisor or 
icr? Somehow the worker did not learn, or did not 
ow, expected behavior patterns for employees. An 
renticeship program with a comphehensive related 
ruction component might have helped that fired worker, 
ited instruction not only provides apprentices with 
inical information associated with job skills, but also Is 
opportunity to teach and reinforce appropriate work 
udes and values. Such attitudes and values are important 
ause they directly affect employee success ancl satis- 
ion on the job. Perhaps more important, work attitudes 
values also affect two Increasingly Important concerns 
today's workplace: productivity and product quality, 
tracterlstlcs like pride in work, adherence to rules, 
owing directions, punctuality and other work attitudes 
! traits are hallmarks of successful employees. They 
uence work that results in reliable products and In- 
sed efficiency. 

"his chapter is about assessing work-related attitudes and 
udes directions for constructing and using instruments 
ivaluate apprentice work attitudes and values, /liter you 
e completed work In this unit, you will demonstrate 
ir competence in assessing attitudes by being able to: 

. Identify and list the work-related attitudes required 
by an apprentice in order to function with approval in 
the workplace. 

. Design and construct an instrument for assessing and 
recording work attitudes. 


critical to the job, then workers must conform to ce 
rules for interaction. If interaction with the public is Ur 
tant, then certain rules for dress, manner and discc 
must be followed on the job. In each instance, these i 
could be addressed in related instruction as a specific cc 
content. In fact, you should include the ideas in your 
forinance objectives, design your evaluation instrmr 
around the attitudes, and include the information as p< 
the data you provide to the program sponsor. 

Assessing work-related attitudes and values is tllfft 
from the typical testing in related subjects Instructor 
cause usually there is no single correct answer for 
question or item. Instead, the real issues are to detert 
(a) what attitudes are important and (b) where or ho 
set the outpoint that divides good and poor attitudes or 
particular topic. 

Several types of assessment instruments are use 
quantify and describe attitudes. These Include tests, r: 
scales ancl anecdotal records. The latter two types of as 
ment are recommended for related subjects instruct! 
settings. A typical test is not recommended because ii 
self reporting document, and an apprentice could tell 
anything he or she wanted to tell you. 

There are several cautions to remember in construi 
attitude instruments. First, you must have several exair 
of behavior. Assessment of work-related attitudes id 
should occur either continually or periodically throng 
the period of related training. You must observe apprei 
behavior in a number of situations and settings since 
tude assessment implies that present behavior is a i 
indicator of future behavior on the job. Second, ho^ 
and whenever assessment of apprentice attitudes t 

nlarp alwavs rpmpmhpr that vnu mnsr rrenr ihp result*; 


p 1: Make a List of Attitudes and Values 

Consider trades and crafts for which the members of 
ir related instruction class are training. Ust each work 
atecl attitude, characteristic or trait that is important to 
:h of those jobs on a sheet of paper. On the same sheet, 
side each listed trait, note briefly why the attitude or trait 
important—specifically how does it influence perform- 
ce? In trying to identify attitudes and traits it is usually 
Ipful to consider factors such as social and organizational 
luexts of work, procedure and product performance 
reifications, and employee discretion. Also consider the 
.ponsibility, authority and decisions each apprentice 
ist make. 

p 2: list Behaviors Indicating Good Attitudes 

‘After listing each attitude or trait, consider the set of 
rformances by a worker that demonstrate that the worker 
s a positive orientation toward each attitude. In addition, 
agine a set of performances in which the worker demon- 
ues a negative orientation toward the attitude in question, 
ite the elements of the positive orientation on the appro 
ate line next to the characteristic. 

p 3: Rank Attitudes 

Rank the work attitudes, characteristics and traits accord- 
> to their importance in the trades for which the appren 
es in your class are training. Enter the rank beside each 
m. 

p 4: Incorporate Attitude Objectives in Your Instruc- 
nal Plan 

Develop several performance objectives that express the 
peciation that apprentices will master and display the 
v;r tmnnrt- nt work nttit des nr r anrter'stirs. neli de 


assign that performance a numeric value on a scale. V 
using Riling scales make observations at regular, prescr 
intervals. Score the scale by averaging the rating on sit 
items or categories of items. The general rules to folic 
constructing and using a rating scale are the following 

1. include on the scale each item or element to be i 
as a separate rule, together with the rating scale 
the directions for use. 

2. Rate each item or attribute one element at a time 
mark the judgement in the correct spot. 

3. Hate each item according to an initial judgement 
do not change the rating at a later time. 

4. Rate each item in accord with prespecified perf 
ance criteria. Avoid extreme ratings and avok 
influence of past performance and extraneous 1 
enees. 

5. Use consensus or multiple ratings when possibli 

Figured illustrates a typical work attitude rating scale 
sample scale is designed for use with Individual apj 
tices. it has a uniform date of observation, includes a s 
of items covering many work attitudes, and is score 
circling a number that represents the value of the p< 
rnnnce observed. 


Anecdotal records 

Anecdotal records are a second type of instrumcr 
assessing work-related attitudes. Anecdotal records ret 
observation, but are not as formal as rating scales. Ins 
use them to note behavior as you work each day will 
apprentices in your charge. They are most useful I 
instructor looks for critical incidents or behavior that a 
associated with attitudes. 'Hie behaviors or attitudes sli 
be specified In the expectations or course objective! 

\>rv ntv*ivirv=< sinri PYnl'iin tn ndv nrv» nt ' lQiri rflnn 


:e of Observation: 


? abo\'e named apprentice demonstrated the level of performance indicated below on the listed work attitude attriln 
ing this related subjects term: 


Areas of Concern 

Demonstrates punctuality by being on time and rarely absent 

Shows considerable interest in working in the trade 

Approaches work In a resourceful manner 

Completes an appropriate amount of work 

Finishes products that meet or exceed industry-accepted standards 

Uses tact in expressing self and interacting with others 

Follows directions, instructions and prescribed procedures 

Accepts and uses suggestions of and instruction from the supervisor 

Does not interfere with work being done by others 

Works cooperatively with others 

Fxercises care in handling and use of tools, equipment, and materials 
Follows industry-accepted safety rules 
Seems to enjoy work and working 
Demonstrates pride in working performed 

Kxhibits appropriate Industry-related grooming, dress and hygiene practices 

Works steadily with few breaks 

Does what he/she say they will do 

Seeks to Improve job performance 

Has a positive, balanced outlook about life in general 

Can be counted on to fulfill work responsibilities 


Level of Performance 
Low Hi 

12 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3 4 

I 2 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3-1 

12 3 4 

12 3 4 




fne Period,Term: ___ 

ic above named apprentice is considered to exhibit appropriate tradesworker responses to the work attitudes listed lx 
iless otherwise noted 


Date of Problem 


Item 


Comments 


I. Dependability 

I 1 a. At assigned work station or in class 

within 3 minutes of expected time 
_I b. Responds truthfully 

. I c. Stays on the job without excessive breaks 

1 I d. Completes tasks in required time 

I I e. Does what he/she say they will do 

I— I f Follows directions, instructions and 

_ prescribed procedures 


II. Acceptance of Supervision 

] a. Accepts and uses supervisors' suggestions 

] b. Pays attention to directions and 
demonstrations 

] c. Discusses instructions but does not argue 


III. Personal Standards 

] a Maintains appropriate and acceptable 
personal grooming practices 
] b. Maintains appropriate and acceptable 
personal hygiene standards 







c. Helps others when requested to do so hv 
supervisor 

d. Interacts appropriately with eo workers 

e. 


V. Performance Quality 

a. Ivxereises appropriate safety precautions 
at work and learning stations 

b. Performs consistent with demonstrated 
levels of ability and skill 

c. Shows interest and enthusiasm for job 
and trade 

d. Demonstrates initiative, resourcefulness and 
aggressiveness 

e. Works steadily and at an 
appropriate speed 

f. Checks work for -accuracy and quality 

g. Produces an acceptable amount of work 

h. Organizes work, materials and tools prior 
to undertaking task 

i. Does not abuse or misuse tools, 
equipment and materials 

j. Recovers quickly from setback or 






men, would he required to work harmoniously with other 
workers as wcfl as to interact with the public Interacting 
with the public was viewed as particularly critical because 
of increasing costs of auto repair and newspaper reports 
about some mechanics -not associated with the Council — 
who had done shoddy work. Therefore, work-related atti¬ 
tudes such as honest)' were perceived to he of utmost 
importance. Daily, therefore, incorporated attitude instruc¬ 
tion and assessment into his related subjects course. As he 
analyzed the jobs for which the apprentices in his charge 
were training, he decided that three categories of work- 
related attitudes were important: (a) customer relations 
attributes; (hi honesty; and (c) pride in work. As he visuali¬ 
zed the performances of workers that would demonstrate 
positive and negative behaviors of these attributes, he gen¬ 
erated the following fist of critical performances: 

1. Uses tact expressing self and working with others; 

2. Inhibits industry-accepted personal grooming, dress 
and hygiene practices; 

3. Docs what he/she says they will do; 

4. Works steadily with few breaks; 

5. Completes work that meets or exceeds standards of 
quality; 

6. Demonstrates pride in work performed; and 

7. Appears to enjoy work and working. 

Dally decided that he would develop a rating scale to 
note the behavior of each apprentice on each item. Further, 
he decided that he would rate apprentices monthly on 
each of these characteristics. He would then develop a 
summary rating at the end of the related studies period. He 
decided to use a four-point rating scale to assign a valtie to 
apprentice behavior about each item. Figure 6 shows the 
rating scale for one of Daily’s students. 


I. List as many of the work-related attitude 
for tlie jobs for which apprentices in yin 
[raining. 


2. list the advantages to your using a rat 
opposed to using an anecdotal record. 


3. Design an anecdotal record for use with 
tlces in your charge. What elements are 
the record? 


Additional Information 


tucles 


Uses tact in expressing self and working 1 

k vith others 

Rxhibits industry accepted personal I 

grooming, dress and hygiene practices 

Does what he/she says they will do 1 

Works steadily with few breaks 1 

Completes work that meets or exceeds 1 

standards of quality 

Demonstrates pride in work performed 1 

Appears to enjoy work and working 1 


entice Nome: 


1 = Poor 


3 = Good 


October 

November 

December 

2 © 4 

1 2 © 4 

1 2 © i 

© 3 4 

1 © 3 4 

1 2 © 4 

2 © 4 

1 2 3 © 

12 3© 

2 © 4 

1 2 © 4 

1 2 © 4 

2 © 4 

12 3© 

1 2 © 4 

2 3 © 

1 2 3 © 

12 3© 

2 3 © 

1 2 3 © 

1 2 3 © 











Introduction And Objectives 

1-valuation consumes a substantial amount of teacher and 
struetional time. To ensure that the investment of time 
id effort pays an adequate return, you must consider the 
es of test results as you construct the instrument. 

Test or evaluation results should be used for three major 
itposes: (a) feedback to apprentices; (b) feedback to the 
structor; and (c) certification and permanent record of 
suits. Each use requires that you as a related instructor 
nploy different skills. This chapter is about providing feed 
ick to apprentices by discussing individual evaluation 
suits with trainees. When you have completed your work 
this section of materials you will demonstrate your com- 
notice in this skill by being able to: 

1. list and discuss in writing the major functions of using 
Individual evaluation resutis with apprentice learners. 

2. Outline a technique for providing feedback systemati¬ 
cally to apprentices in your class. 

As you work through the following materials you should 
Ink about how test results currently are conveyed to 
iprcnticcs in the program. Does the following information 
ggesi uses of results that you do not practice routinely in 
»iir class? 


What And Why Should You Discuss 
Test Results 

A major purpose of evaluating learning is to provide 
edback 10 apprentices about tiieir success in learning 
ibject matter and skills. In that capacity, testing provides 
formation that stimulates and clarifies the learning task, 
rves as a study aid, provides a reward and produces appro 


of learning and encourages the use of short-term gc 
Take, for example, a segment of a related subjects coins 
graphic arts where the principles of color were being 
cussed. Tlie discussion of ewluation results using presp 
fied objectives established the outcome expectations 
each past and future section of materials for the apprent 
Objectives included outcomes such as naming prin 
colors, describing (he interaction of various ink colors 
grades of paper and matching appropriate color of pn 
and ink for various types of printing jobs. The object 
and the evaluation exercises based on these objectives ii 
cated precisely what performances and levels of proficie 
were expected of the apprentice alter instruction. Thi.* 
turn, suggested the specific content that was to be maste 
It also provided a specific, short-term time period and j 
in which to learn the material, further, when the for 
was followed consistently, apprentices learned to fc 
efforts on ideas presented in objectives and verified thro 
the discussion of evaluation. 

Service as a Study Aid 

Discussing test results serves as a study aid for (he le 
Ing task by demonstrating the relationship between reh 
studies and job task performances. The oppertuniP 
practice knowledge application in real or simulated si 
lions is available to the apprentice attempting to in: 
related materials. Further, such practice, even if perfori 
in written or simulation situations, offers an opportunii 
transfer skills and knowledges from one situation to anot 
Tills reinforces retention of conient. 


isl /ip A D/i\i s-tvrl 


■propriate work attitudes. Use of test results as part of the 
structional process helps to instill the notion of the appro 
ialeness of work (process and product) assessment on 
e job by supervisors and foremen. Accepting and using 
e results of work evaluation on the job is an important 
srned behavior. It is important not only to work, but also 
job retention and advancement. It reinforces the ideas of 
talliy control, merit advances, taking directions and the 
^itimacy of external evaluation. 


When And How To Discuss 
Test Results 

Any of these functions of discussing evaluation results 
rjuircs a structure and forum for presenting and using the 
formation, 'resting results can be discussed effectively 
th an entire related studies class, If it is done so no 
divlduals arc identified and if the class is working at the 
me general rate of progress on the same topic. A more 
eferrabie procedure is individual conferences conducted 
regular intervals throughout the related subjects instruc- 
•nal period. 

Individual conferences provide you with opportunities 
get lo know each apprentice on a more personal basis, 
icy also offer you an opportunity to enter the results of 
test on the permanent record and obtain the appren- 
e s signature on the record in recognition of the grade, 
xc or mark. 

Individual conferences should be held on a regular basis, 
rhaps as often as ever)' month. The discussion time can 
used to clarify performance expectations, to assist the 
prentice in structuring time, to discuss problems and 
ncerns, and to bring closure to various segments of 
ated instruction. 

When holding the conferences, establish a general agenda 
topics and time to follow with each apprentice. The 


Step 2: Develop a Schedule 

Schedule a time for all conferences and post it in a pi 
place at least one week before initiation of the first co 
ence. The schedule should note the name, date, loa 
and time for the conference with each apprentice. Also 
schedule should list the general topics of concern an 
dicate any prior preparation of materials that appren 
are expected to bring with them to the conference scs: 

Step 3: Prepare For Each Conference 

Review information such as grades, progress, attend* 
and results of past conferences on each individual apj: 
tice before the time for the conference. Make notes ii 
margin of individual’s agenda about particular point 
concerns you want to raise during the conference. 

Step 4: Conduct the Conferences 

In conducting the conference, use the time cfficit 
and effectively. Start on time, move crisply from top 
topic, and address any subject of concern to either yo 
the apprentice. F.ffective conferences can be as short a 
minutes or as long as 30 minutes. 

lyjtabllsh a conference atmosphere that is comfort 
yet work like. You should assume the role of a forema 
supervisor and the apprentice that of a worker in 1 
charge. In those roles, you will serve both as ndvocau 
and evaluator of apprentice work. You want the apprci 
to succeed and to perform well both because It repres 
growth for the apprentice and be cause it reflects wel 
you. Your discussion must be frank and open, wit! 
reprisals and without carrying over into the classroom, 
should offer evidence and examples to support the pc 
or conclusions you make during the conversation. 
important, you must listen to the concerns and pc 
offered by the apprentice. Remember that the tone yoi 



.■hid) Janies trained apprentices in more than a dozen 
ifTerent apprenticeable occupations including electrician, 
.elder, shipfitter, pipefitter and shectmetal worker. James' 
cometry and algehra related subjects classes usually in 
ludec! apprentices from four or five different occupations, 
unher, his classes were usually large and the apprentices 
ossessed a wide variety of backgrounds and skills. 

One result of the diversity was James had noticed that 
very time he taught the class some apprentices usually had 
ouble completing the mathematics requirements success- 
illy. Additionally, they often seemed frustrated with their 
rades. Further, grades held different values for different 
ainecs. 

James decided to use the technique of individual confer 
nces to discuss grades and to set content goals for each 
pprentice during the mathematics classes he taught. He 
ecided that even though each of his classes was only six 
•eeks in length, he could schedule ten minute conferences 
very two weeks with each apprentice for both the algebra 
ad geometry sections He followed the steps outlined in 
ic unit on discussing test results and began the first set of 
inferences after the first test. The first agenda he construct 
:l is presented in Figure 7 Note that Janies wrote out the 
?emla and filled in the form as the discussion with appren- 
.c Howard Tilley occurred. He addressed content and 
•suits of the test recently taken; general progress in the 
rograni, upcoming topics and contents; and goals for the 
ncoming content and sessions. When the conference was 
implcted, James placed the agenda for each apprentice in 
ie work folder for that apprentice. 

James found that after the first two conferences, he could 
;t the conferences at three week intervals. After several 
.ssions of conferences James found that both apprentice 
st scores and reports of satisfaction with training had 
iproved. 


■idl'd or on separate work paper Cheek your aiisnv 
eferring to the appendix in the hack of the t/ookict 

I. list in one sentence, short answer form the four r 
benefits of discussing test results with appientici 


2. Stephen Carlton was related Instructor in a si 
metal apprenticeship program. I le felt that he wa: 
getting the maximum effort from his apprei 
charges so lie decided to initiate individual eo 
cnees to discuss test results and set academic goa 
a motivator. Fie followed the first several steps 
lined in the materials regarding conferences inclu 
constructing an agenda, setting up a .schedule, re\ 
ing past performance and so forth. However, he 
unclear exactly how to behave in interacting wit 
individual apprentice during a conference. What n 
things would you advise Carlton to do in eoncliu 
tlic discussion in the conference? fist five items. 


3. Consider your trade and related subjects obligat 
and construct a model agenda for an Indivii 
conference with your apprentices. Check your m< 




C. Discussion: 
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^coming Topics ancl Contents 
A. Content or Topics; 

i. vplvtk\e$ ay brxa^fcs 
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theorem 
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Ana Knowledges upon completion or 
Program Or Course 


Introduction And Objectives 

Once you have performed your evaluations, you must 
?port tile findings about individual performance regarding 
squired knowledges and skills to the program sponsor. It 
; critical that you describe precisely what knowledges and 
fills each apprentice possesses and explain how itv/Uhe 
:vel of knowledges and skills acquired compares to trade 
andards. Further, you must report that information system 
ically for each apprentice. This means that you must create 
id use a consistent record keeping system for certifying 
id reporting skills and knowledges for all apprentices, 
his chapter is devoted to providing you with ideas and 
irmats for maintaining standardized individual and group 
lowledge and skill record keeping operations. When you 
ive completed your work in this section of materials, you 
111 demonstrate your competence in this skill by being 
lie to: 

1. List the critical elements in a systematic certification 
record. 

2, Critique and develop sample Instruments useful to 
certify apprentice knowledges and skills. 

As you work through this unit of materials, examine the 
struments and devices you use currently to certify and 
poti related subjects knowledges and skills. Do they in 
cate the necessary information? 

fhy, When And What Is Record Keeping About 

You arc obligated to keep records for botli le al reasons 


attendance and time in instruction by content. These rec 
document apprentice progress and, in most training 
grams, are used by the program sponsor to make decis 
about advancing the apprentice in grades of pay and res 
sibility. Your records must be accurate, current and in 
ficicnt detail for making recommendations and dccis 
about each individual apprentice. 

A second important legal aspect of grading and rc 
keeping is that the performance standards for each app 
tice in a trade or craft must be reasonably similar. Perf< 
ance outcomes and types of reporting In related sub 
instruction cannot vary appreciably from apprentic 
apprentice. Not only arc you required to certify to 
program sponsor that the apprentice lias mastered ce 
necessary skills and knowledges, but also you are expe 
to provide your judgment on expected succeess in 
trade for each apprentice. Make certain that you a? 
apprentices using equal means and report findings in s 
lar ways. The equal opportunity Is particularly critical g 
that some apprentices simply do not master the necef 
knowledge and skills to become certified journeymen 
some apprentices do not complete their training. 

A final important legal aspect of related subjects insi 
tion records involves reimbursement. Because fund 
support the related instruction activity' may come from 
or more of a variety of sources (I.e., union training fu 
employer training budget, state education agency) you r 
be able to certify the contact hours of instruction and 
hours of facility' use for each apprentice. 

Records also arc important for keeping track of apprer 
learning activities. A visible progress record for all an 3 


dectrical resistance. Your composite record of apprentice 
>gress would suggest and justify your decision to alter 
truction on the two topics. 

.Vhatever record keeping and reporting system you use, 
s critical that the records be accurate and up-to-date, 
ke your entries as often and as long as necessary in order 
insure that at any time up to four years later, a sponsor 
•h as a 1JATC making a final appraisal of an apprentice’s 
Ms and knowledges could determine precisely what the 
ord was reporting. 

How To Set Up A Record Keeping 
And Reporting System 

"■he procedures recommended in setting up a record 
jplng and reporting system arc tied to the type of record 
ng developed. It is recommended that you keep one 
jrall record of composite progress and two types of indi¬ 
cia! records, one for knowlcdgcs/skills/attitudcs and one 

Figure 8: Progress 


n'entlce Name 


Talk with the program sponsor—LJ aTC, employer 
school—to determine if the specific type of record keep 
and reporting system is prescribed. In addition, con: 
industry standards to determine if suggestions about n 
of record systems are offered. If so, use these ideas 
conjunction with the ideas offered below. 

Step 2: Develop Aral Ike an Overall Perfomiance Reco 

Consider the alternative ways for maintaining an ovei 
progress record of apprentices. Choose one possibility a 
develop and use the Instrument. Two types of progr 
records are suggested. One is a type of bar graph as c 
played in Figure 8. Tills type of record is a graphic used 
public display of the general progress of each apprenti 
Apprentices’ names are listed in the left hand colm: 
Content areas or performance objectives are listed in i 
numbered areas across the top of the figure. As each appr 
rice performs to the level of success for each criteria witl 
each objective, a check or line is extended from the appr 

Record of Apprentices 

Performance Objective/Content Area 

#1 #2 #3 #4 #5 

Criterion Criterion Criterion Criterion Critcrioi 


a 


b a b a 


a b 


a l 





es* name th/ough tlicir current end point. The progress 
an should be on public display and should be up dated 
:h week. It will permit you as the instructor (as well as 
ch apprentice) to monitor individual progress. 

A second type of progress schedule is more lor your 
cision making and is not necessarily intended for display, 
is type of record is illustrated in Figure 9. As you wiil 
te, the record systematizes collection and storage of sum- 
try data from apprentices ne'er a period of time on each 
the performance objectives or content areas in related 
bjects instruction. Ihe record requires that you note in- 
rnation such as the time required by most apprentices to 
rn the materials, the average score on each criterion for 
:wps of apprentices and the average number of items 
swered correctly. Such information is useful to you as 
u make future instructional decisions about materials, 
ntent and criteria. 

?/> 3: File Records 

Set aside a space such as a single file drawer or a box as a 
2 for apprentices’s records. Provide a folder or envelope 


gram for the American Public Works Association m 
specify at least 144 hours of related instruction per y 
Assume that within that 144 hours during the final year 
hours must be spent on studying communication skills 
hours on law and labor relations and so forth. You ; 
related subjects instructor must keep track of each app 
t ice s’ time in class and on each topic. Figure 10 Is a ret 
that facilitates keeping this kind of data. Note that the ret 
should be maintained for each apprentice and that 
record includes data on outcomes, attendance and to 
for each month or two of the related subjects expcrlenc 
is often useful to maintain a second copy of the recor 
the apprentice’s individual file. 

Stef) 5: l*repare and maintain individual progress recc 

'Ibis record should be updated with each asscssn 
activity, should be initialed by the apprentice and 
instructor (in an Individual conference), and should 
kept as part of the individuals’s record. This record sht 
be copied and provided to the program sponsor as 


rfonnace 

jjcctivc/Contenr 


Period of Attendance 



Figure 10 


Example 


example of the need for and operation of a record 
;ping system might be found in the training program of 
local electrical apprentice training program. Assume that 


performance records were a necessity. Time was kept 
overall attendance and for tlmeonconicnt because in 
national curriculum a given number of hours were 
scribed for subjects such as aspects of algebra, trlgonon* 
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Figure 11 


Self-Test Exercises 

Please answer the following questions in the space pro¬ 
vided or on separate work paper. Check your answers by 
refen ing to the appendix at the back of the booklet. 

1. List two reasons for maintaining certification records 
in related instruction. 

2. Design art apprentice performance record for your 
class. 
















Answers To Self-Test F.xercises 

\KILL-. Assess Trainee Knowledge And Skills 

la. Simulation-situation 

lb. Simulation-situation 

c. Knowledge-identification 

ki. Blanks give clues to correct answer. 

5b. Use of negative construction; correct answer was 
longer; correct answer was stated as only option in 
positive construction. 

>K!LL: Devise Means And Asess Apprentice 
Work-Related A ttitudes A nd Values 

. Among the categories of concern you should have 
considered are: 

a. Trustwonhlness/dependability 

b. Work habits/patterns 
e. Quality performance 

d. Personal standards 

:. Advantages of use of rating scale include: 

a. Numerical value to behavior 

b. Comparable ratings for each apprentice 

c. Emphasis on all important points 

d. Ratings at regular intervals 

>. The elements that the anecdotal record must Include 
are: 


2. Suggestions for conducting a conference include 

a. Start on time and use time efficiently 

b. Make (he apprentice comfortable 

c. Assume die role of a supervisor 

d. Be frank and open 

e. Offer evidence to support the topics of discus 

f. Listen to and address the apprentices’s concei 

g. Don’t let the discussion carry over ncgaiivel 
the classroom 

h. Follow topics outlined in agenda 

i. Encourage training goal setting on the part ol 
apprentice 

j. Agree on goals for the next training period 

5. SKILL: Develop Instrumentation To Certify Skills 
And Knowledges Upon Completion 
Of Program Of Course 

l. Reasons for maintaining certification records: 

a. Satisfying the legal aspects of the npprentice 
agreement: 

— Certifying that apprentices completed requ 
instruction 

—- Certifying that apprentices possess neces 
skills 

—- Providing information for relmbuisemen' 
training sponsors 

b. Keeping track of apprentice learning actlvitic 
order to make instructional decisions 


a. Identification of individual apprentice 

b. Date of occurrence of critical incident 

c. Accurate description of Incident 

■K/LJ.: Discuss Individual Evaluation Results 
With Apprentice learners 


